PATENT 

f Docket No. 1232-4512 

Express Mail Label No. EE645143221US 

IN THE UNITED STATES PATENT AND TRADEMARK OFFICE '^'^ ^ 

UTILITY APPLICATION AND APPLICATION FEE TRANSMTTTAL a.53fb^^ atg 

ASSISTANT COMMISSIONER FOR PATENTS 
Box Patent Application 
Washington, D.C. 2023 1 

Sir: 

Transmitted herewith for filing is the patent application of 
Named Inventor(s) and 

Address(es): Taeko TANAKA, 324-72, Hazawacho, Kanagawa-ku, Yokohama-shi, Kanagawa-ken, 

Japan 

For; IMAGE SENSING METHOD, IMAGE SENSING APPARATUS, LENS CONTROL 

METHOD THEREFOR, AND STORAGE MEDIUM 

Enclosed are: 

[X] 63 page(s) of specification, J_ page(s) of Abstract, 14 Page(s) of claims 

[X ] 20 sheets of drawing [X ] formal [ ] informal 

[X ] _6_ Page(s) of Declaration and Power of Attorney 

[ ] Unsigned 

[X] Newly Executed 

[ ] Copy from prior application 

[ ] Deletion ofinventors including Signed Statement under 37 C.F.R. § 1.63(d)(2) 

[X] Incorporation by Reference: The entire disclosure of the priority application(s) identified below, is 

considered as being part of the disclosure of the accompanying apphcation and is incorporated herein by 
reference. 

[ ] Microfiche Computer Program (Appendix) 

[ ] page(s) of Sequence Listing 

[ ] computer readable disk containing Sequence Listing 

[ ] Statement under 37 C.F.R. § 1.821(f) that computer and paper copies of the Sequence Listing are 
the same 

[X] Claim for Priority Japanese Patent Application Nos 10-061970 filed 2/27/98: and 10-071545 filed 3/20/98 



451107_1 



Docket No 1232-451: 



[ ] Certified copy of Priority Document(s) 
[ ] English translation documents 

[ ] Information Disclosure Statement 

[ ] Copy of cited references w/ English Ahstracts 

[ ] Copy of PTO- 1 449 filed in parent appUcation serial No. . 

[ ] Preliminary Amendment 

[ X] Return receipt postcard (MPEP 5 03) 

[ X] Assignment Papers (assignment cover sheet and assigiment documents) 

[X] A check in the amount of $40.00 for recording the Assignment. 

[ ] Assignment papers filed in parent application Serial No. . 

[ ] Certification of chain of title pursuant to 37 C.F.R. § 3.73(b). 
[ ] This is a [ ] continuation [ ] divisional [ ] continuation-in-part (C-I-P) of prior application serial no. 

[ ] Cancel in this application original claims of the parent application before 

calculating the filing fee. (At least one original independent claim must be retained for filing 
purposes.) 

[ ] A preliminary Amendment is enclosed. (Claims added by this Amendment have been properly 
numbered consecutively beginning with the number following the highest numbered original 
claim in the prior application. 

[ ] The status of the parent application is as follows: 

[ ] A Petition For Extension of Time and a Fee therefor has been or is being filed in the parent 

application to extend the term for action in the parent application until . 

[ ] A copy of the Petition for Extension of Time in the co-pending parent application is attached. 

[ ] No Petition For Extension of Time and Fee therefor are necessary in the co-pendmg parent 
application. 

[ ] Please abandon the parent application at a time while the parent application is pending or at a time when 
the petition for extension of time in that appHcation is granted and while this application is pending has 
been granted a filing date, so as to make this appHcation co-pending. 

[ ] Transfer the drawmg(s) from the patent application to this application. 

[ ] Amend the specification by inserting before the first line the sentence: 

This IS a [ ] continuation [ ] divisional [ ] continuation-in-part of co-pending application Serial 
No. filed . 



-2- 

451107_1 



Docket No 1232-4512 



I. CALCULATION OF APPLICATION FEE (For Other Than A Small Entity) 













Basic Fee 




Number Filed 




Number Extra 


Rate 


$ 760.00 


Total 
Claims 


29 


-20= 


9 


x$ 18.00 


$ 162.00 


Independent 
Claims 


15 


-3= 


12 


X78.00 


$ 936.00 


Multiple Dependent Claims 


[ ]yes 
[X]no 




Additional Fee = 
Add'l Fee = 


$260.00 
NONE 


$ 



Total: $1,858.00 

[ ] A statement claiming small entity status is attached or has been filed in the above-identified parent 

application and its benefit under 37 C.F.R. § 1.28(a) is hereby claimed. Reduced fees under 37 C.F.R. 
§ 1.9(F) (50% of total) paid herewith $ . 

[ X] A check in the amount of $1.858.00 for payment of the apphcation filing fees is attached. 

[ ] Charge Fee(s) to Deposit Account No. 13-4500. Order No. . A DUPLICATE COPY OF 

THIS SHEET IS ATTACHED. 

[ X ] The Assistant Commissioner is hereby authorized to charge any additional fees which may be required for 
filing this application, or credit any overpayment to Deposit Account No. 13-4500, Order No. 1232-4512 . 
A DUPLICATE COPY OF THIS SHEET IS ATTACHED. 

Respectfully submitted, 

MORGAN & FINNEGAN, L.L.P. 



Dated: February 24. 1999 By: l^^^-^^^^^^^^- 

Michael M. Alurray y/\ 
Registration No 3Y531J 

CORRESPONDENCE ADDRESS: 

MORGAN & FINNEGAN, L.L.P. 

345 Park Avenue 

New York, New York 10154 

(212)758-4800 

(212) 751-6849 Facsimile 



451107_1 



-3- 



TITLE OF THE INVENTION 
IMAGE SENSING METHOD, IMAGE SENSING APPARATUS, 
LENS CONTROL METHOD THEREFOR, AND STORAGE MEDIUM 

5 BACKGROUND OF THE INVENTION 

The present invention relates to an image 
sensing method, an image sensing apparatus, a lens 
control method therefor, and a storage mediiim storing 
a control program for controlling the image sensing 
10 apparatus . 

Fig. 5 shows the schematic arrangement of an 
inner focus type lens system in a conventional image 
sensing apparatus. Referring to Fig. 5, reference 
numeral 501 denotes a first stationary lens; 502, a 
15 zoom lens for zooming; 503, a stop for light amount 
adjustment; 504, a second stationary lens; 505, a 
focus lens (focus compensation lens) having both a 
focus adjustment function and a so-called compensation 
function of correcting the movement of a focal plane 
20 upon zooming; and 50 6,. the imaging plane of an image 
sensing element such as a CCD. 

In the lens system having the arrangement shown 
in Fig. 5, since the focus compensation lens 505 has 
both the compensation function and the focus 
25 adjustment function, the position of the focus 

compensation lens 505 to be focused on the imaging 
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plane 506 varies depending on the object distance even 
if the focal length remains the same. 

Fig. 6 shows the result obtained by changing the 
object distance at each focal length, and continuously 

5 plotting the position of the focus compensation lens 
505 to be focused on the imaging plane 506. Referring 
to Fig. 6, the ordinate indicates the position of the 
focus compensation lens 505; and abscissa, the focal 
length (the position of the zoom lens) . 

10 If one of the loci in Fig. 6 is selected in 

accordance with the object distance, and the focus 
compensation lens 505 is moved along the selected 
locus during zooming, zooming can be done without any 
blur . 

15 A front-element focus type lens system has a 

compensation lens independently of a zoom lens. The 
zoom lens and the compensation lens are coupled to 
each other through a mechanical cam ring. Assume that 
this cam ring has a knob for manual zooming, and the 

20 focal length is to be changed manually. In this case, 
the cam ring rotates following the movement of the 
knob, and the zoom lens and the compensation lens move 
along the cam groove of the cam ring. As long as the 
focus lens stays focused, no blur is caused by the 

25 above operation. 

In general, in control operation in the inner 
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focus type lens system having the above 
characteristics, a plurality of pieces of locus 
information shown in Fig. 6 are stored in advance, in 
some form, in the lens control microcomputer, and a 
5 locus (cam locus) is selected on the basis of the 

positions of the focus lens and the zoom lens, thereby 
zooming along the selected locus . 

To read out the position of the focus lens 
relative to the position of the zoom lens from the 
10 storage element and use it in lens control, the 

position of each lens must be read accurately to some 
degree. As is obvious from Fig. 6 as well, when the 
zoom lens moves at a constant speed or nearly constant 
speed, in particular, the slope of the locus of the 
15 focus lens changes from moment to moment with changes 
in focal length. This indicates that the moving speed 
and the slope of movement of the focus lens change 
from moment to moment. In other words, an actuator for 
the focus lens needs to have speed response 
20 characteristics with a high precision of 1 Hz to 
several hundred Hz . 

As an actuator, i.e., a focus lens driving motor, 
in an inner focus type lens system, which satisfies 
the above requirement, a stepping motor is generally 
25 used. The stepping motor rotates in perfect 

synchronization with step pulses output from the lens 
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control microcomputer or the like. Since the step 
angle of the motor per pulse is constant, high speed 
response characteristics, high stop precision, and 
high position precision can be obtained. 
5 When a stepping motor is to be used, since the 

rotational angle is constant with respect to the 
number of step pulses, these pulses can be used as an 
incremental encoder. Hence, no special position 
encoder is required. 
10 As described above, when zooming is to be 

performed by using a stepping motor while the object 
is kept in focus, the locus information in Fig. 6 must 
be stored in advance, in some form (loci themselves or 
a function using the lens position as a variable) , in 
15 the lens control microcomputer or the like, and the 
focus lens must be moved on the basis of the locus 
information read out in accordance with the position 
or moving speed of the zoom lens. 

Figs . 7 and 8 are views for explaining an 
20 example of conventional locus tracking methods. 

Fig. 7 shows the in-focus locus of the focus 
lens, accompanying the movement of the zoom lens, for 
each object distance. Each locus is specified by the 
zoom lens position, i.e., the focal length, and the 
25 focus lens position, i.e., the object distance. The 
object can be maintained in focus during zooming by 



driving the focus lens along the locus . 

Fig. 8 shows how the cam locus information in 
Fig. 7 is stored in the lens control microcomputer (or 
external memory) . Referring to Fig. 8, a variable v 
5 indicates the focus lens position (zone) in the object 
distance direction, and a variable n indicates the 
zoom lens position (zone) in the focal length 
direction. Data A(n, v) representing the focus lens 
position is specified by these pieces of information. 
10 Referring to Fig. 7, the ordinates indicates the 

focus lens position; and the abscissa, the zoom lens 
position (zO, zl, z2 , . . . , z6). In addition, Ll(aO, al, 

a2,..., a5) andL3(bO, bl , b2 , , b6) are 

respectively the representative loci stored in the 
15 lens control microcomputer. L2 (pO , pi, p2 , . . . , p6) is 
the locus calculated on the basis of the above two 
loci Ll and L3 by 

p(n+l) = |p(n) - a(n)|/|b(n) - a(n)|xlb(n 
+ 1) - a(n+l) 1 + a(n+l) 
20 According to equation (1) , in the case shown in 

Figs. 7 and 8, when the focus lens is located at pO , 
the ratio at which pO internally divides a line 
segment bO - aO is obtained, and a point that 
internally divides a line segment bl - al at the 
25 obtained ratio is defined as pi. The moving speed of 
the focus lens at which an in- focus state is 
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maintained can be obtained from the difference in 
position between the points pi and pO and the time 
required for the zoom lens to move from zO to zl. 

Consider a case in which the zoom lens need not 
5 stop on only boundaries having the stored 
representative locus data. 

Fig. 9 is a graph for explaining interpolation 
in the zoom lens position direction. This graph shows 
a portion of Fig. 7 with arbitrary zoom lens positions. 
10 Referring to Fig. 9, the ordinate indicates the 

focus lens position, and the abscissa, the zoom lens 
position (Zk-1, Zx, Zk) . In addition, Ll(bk-1, bx, bk) , 
L2(pk-1, px, pk) , and L3 (ak-1, ax, ak) indicate the 
representative loci (focus lens positions relative to 
15 zoom lens positions) stored in the lens control 

microcomputer. When the zoom lens positions are ZO, 
Zl,..., Zk-1, Zk, . . . , Zn, the corresponding focus lens 
positions for the respective object distances are: 
aO, al,..., ak-1, ak, . . . , an 
20 bO, bl,..., bk-1, bk, . . . , bn 

When the current zoom lens position is the 
position Zx, which is not on a zoom boundary, and the 
current focus lens position is the position px, ax and 
bx are given by: 
25 ax = ak - (Zk - Zx) x (ak - ak-l)/(Zk - Zk-1) 

... (2) 
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bx = bk - (Zk - Zx) X (bk - bk-l)/(Zk - Zk-1) 

... (3) 

That is, ax and bx can be obtained by internally 
dividing data of the four stored representative locus 
5 data (ak, ak-1, bk, and bk-1 in Fig. 9), which are 

obtained at the same object distance, at the internal 
ratio obtained from the current zoom lens position and 
two zoom boundary positions (e.g., Zk and Zk-1 in 
Fig. 9) on the two sides of the current zoom lens 
10 position. Then, pk and pk-1 can be obtained by 
internally dividing data of the four stored 
representative data (ak, ak-1, bk, and bk-1 in Fig. 9) , 
which are obtained at the same focal length, at the 
internal ratio obtained from ax, px, and bx, as per 
15 equation (1) . When zooming is to be performed from the 
wide-angle side to the telephoto side, the moving 
speed of the focus lens at which an in-focus state is 
maintained can be obtained from the difference in 
position between the destination focus position pk and 
20 the current focus position px and the time required 

for the zoom lens to move from Zx to Zk. When zooming 
is to be performed from the telephoto side to the 
wide-angle side, the moving speed of the focus lens at 
which an in-focus state is maintained can be obtained 
25 from the difference in position between the target 

focus position pk-1 and the current focus position px 
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and the time required for the zoom lens to move from 
Zx to Zk-1. 

The above locus tracking method has been 
proposed. 

5 Again, as is apparent from Fig. 6, in particular, 

when the zoom lens moves from the telephoto side to 
the wide-angle side, the object can be maintained in 
focus by the above locus tracking method. When, 
however, the zoom lens moves from the wide-angle side 
10 to the telephoto side, since a specific locus which 

the focus lens at a convergence point should track is 
not known, an in-focus state cannot be maintained by 
the same locus tracking method. 

Figs. lOA and lOB are graphs for explaining an 
15 example of locus tracking which has been proposed to 
solve the above problem. Referring to Fig. lOA, the 
ordinate indicates the high-frequency component 
(sharpness signal) of a luminance signal, i.e., an AF 
evaluation signal, in the vertical sync period, and 
20 the abscissa, the position of the zoom lens. Referring 
to Fig. lOB, the ordinate indicates the position of 
the focus lens; and the abscissa, the position of the 
zoom lens . 

Referring to Fig. lOA, reference numeral 1001 
25 denotes the maximum value of the level of the 

sharpness signal; 1002, the minimum value (THl) of the 
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level of the sharpness signal; and 1003, the level of 
the sharpness. 

Referring to Fig. lOB, reference numerals 1004 
and 1005 denote cam loci; and 1006, the zoom lens 

5 position. 

Assume that the cam locus 1004 in Fig. lOB is a 
focus cam locus in zooming for a given object. Assume 
that the focus cam locus tracking speeds on the wide- 
angle side relative to the zoom lens position 1006 
10 (Z14) are positive (in the direction of the closest 

focusing distance of the focus lens) , and the in-focus 
cam tracking speeds on the telephoto side relative to 
the zoom lens position 1006 (Z14) on which the lens 
moves toward infinity are negative. Admittedly, when 

15 the focus lens moves along the focus cam locus 1004 
while it stays focused, the level of the above 
sharpness signal becomes almost constant. 

The moving speed of the focus lens that traces 
the focus cam locus 1004 in Fig. lOB in zooming is 

20 represented by VfO, and the actual moving speed of the 
focus lens is represented by Vf . When zooming is 
performed while the moving speed Vf of the focus lens 
is changed with respect to the moving speed VfO of the 
focus lens that traces the focus cam locus 1004, the 

25 resultant cam locus becomes the zigzag cam locus 1005. 
At this time, the level of the sharpness signal 



- 9 - 



changes to produce valleys and crests, as indicated by 
"1003" in Fig. IDA. At each point of intersection of 
the cam loci 1004 and 1005, the level 1003 of the 
sharpness signal becomes maximum (even points of ZO, 

5 Zl,..., Z16) . At each odd point of ZO, Zl,..., Z16, at 
which the moving direction vector of the cam locus 
1005 is switched, the level 1003 of the sharpness 
signal becomes minimiim. 

Referring to Fig. lOA, although reference 

10 numeral 1002 denotes the minimum value (THl) of the 
level 1003 of the sharpness signal, a minimum value 
(THl) 1002 may be set for the level 1003 of the 
sharpness signal, and the moving direction vector of 
the cam locus 1005 in Fig. lOB may be switched every 

15 time the level 1003 of the sharpness signal becomes 

the minimum value (THl) 1002. With this operation, the 
moving direction of the focus lens upon switching can 
be set in a direction in which the lens approaches the 
focus cam locus 1004 in Fig. lOB. 

20 That is, zooming with less blur amount can be 

performed by controlling the moving direction and 
speed of the focus lens to reduce blur every time an 
image blurs by the difference between the maximum 
level 1001 and minimum level (THl) 1002 of the 

25 sharpness signal . 

With the use of the above method, in zooming 



from the wide-angle side to the telephoto side, in 
which the cam loci in Fig. 6 diverge from a 
convergence point, a locus along which the level 10 03 
of the sharpness signal does not become lower than the 
5 minimum value (THl) 1002 in Fig. IDA, i.e., blur does 
not occur beyond a predetermined amount, can be 
selected by repeating switching operation (in 
accordance with changes in the level of the sharpness 
signal) , like the cam locus 1005 in Fig. lOB, while 
10 controlling the moving speed Vf of the focus lens with 
respect to the tracking speed described in the prior 
art (calculated by using p(n+l) obtained from equation 
(1)) even if the focusing speed VfO is unknown. 

In this case, the moving speed Vf of the focus 
15 lens is given by: 

Vf = VfO + Vf+ ... (4) 

Vf = VfO + Vf- ... (5) 

where Vf+ is the correction speed in the positive 
direction, and Vf- is the correction speed in the 
20 negative direction. 

In this case, to prevent offsets in locus 
tracking operation by the above zooming method, the 
correction speeds Vf+ and Vf- are determined such that 
the internal angle the two direction vectors of the 
25 moving speed Vf of the focus lens, which are obtained 
from equations (4) and (5) , make with each other is 
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equally divided into two by the direction vector of 
the moving speed VfO of the focus lens that traces the 
focus cam locus 1004. In addition, a technique of 
improving locus selection precision by changing the 
5 magnitudes of the correction speeds in accordance with 
focal length and depth of field has also been proposed. 
In addition, a method of tracking a locus by using an 
integral signal that sensitively changes with blur in 
place of a sharpness signal has been proposed. 
10 In the prior art described above, the sharpness 

signal is the high-frequency component of a video 
signal. At a shutter speed of 1/60 sec in the general 
NTSC scheme, a video signal can be obtained in each 
vertical sync period, as shown in Fig. IIA. When, 
15 however, the shutter speed decreases, and the charge 
storage time of the image sensing element 506 is 
prolonged, for example, when a shutter speed of 1/3 0 
sec is set as shown in Fig. IIB, a signal stored in 
the image sensing element 506 for 1/3 0 sec becomes a 
20 video signal. Therefore, a video signal is detected 
once per every 1/30 sec, i.e., once per every two 
vertical sync periods. That is, no video signal is 
detected once per every two vertical sync periods. At 
a shutter speed of 1/15 sec, a video signal is 
25 detected only once per every four vertical sync 
periods . 
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Figs . 12A to 12D show the relationship between 
the sharpness signal and the elapsed time at a shutter 
speed of 1/15 sec in an in- focus state in which the 
positions of an object and the focus lens remain the 
5 same. Fig. 12A shows a vertical sync signal; Fig. 12B, 
timing information from shutter speed control; 
Fig. 12C, a video signal; and Fig. 12D, a sharpness 
signal . 

As can be seen from Figs. 12A to 12D, the level 
10 of the sharpness signal changes even as the lens stays 
focused. According to the method of controlling the 
moving direction and speed of the focus lens to reduce 
blur every time an image blurs by the difference 
between the maximiom value 1001 and minimum value (THl) 
15 1002 of the level 1003 of the sharpness signal in 
Figs. lOA and lOB as in zooming operation, zooming 
operation following the object is realized in 
accordance with the difference information between the 
maximum value 1001 and minimum value (THl) 1002 of the 
20 sharpness signal level 1003. When the shutter speed is 
low, e.g., 1/15 sec, information of the minimum value 
(THl) 1002, from which a sharpness signal is obtained, 
is obtained once per every four vertical sync periods . 
That is, the period at which the direction is changed 
25 following the object is prolonged. As a result, the 
object cannot be tracked during zooming. 
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In addition, multiple speed zooming has recently 
become popular, and hence the zoom speeds vary from 
low-speed zooming to high-speed zooming. In this case 
as well, the focal plane must track an object to be 
5 photographed during zooming. 

Since the sharpness integral signal of an AF 
evaluation signal is a value obtained by adding 
sharpness peak signals in a horizontal sync period 
together within a vertical sync period, changes in 
10 evaluation signal are also integrated and appear owing 
to noise caused by camera shakes or the like during 
low-speed zooming. For this reason, whether a given 
change is a change in evaluation signal due to a focus 
lens tracking error during zooming or a change due to 
15 noise or the like cannot be determined. As a result, 
the focal plane cannot accurately track the object 
during zooming. 

Furthermore, in high-speed zooming, since the 
view angle changes steeply, whether a given change is 
20 a change in evaluation signal due to a focus lens 
tracking error during zooming or a change in view 
angle cannot be determined. As a result, the focal 
plane cannot accurately track the object during 
zooming . 
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SUMMARY OF THE INVENTION 
The present invention has been made in 
consideration of the problems in the prior art 
described above, and has as its object to provide an 
5 image sensing method and apparatus which can select a 
focus cam locus and perform focus tracking without 
blur in zooming from the wide-angle side on which no 
focus cam locus is determined to the telephoto side in 
slow shutter operation. 
10 It is another object of the present invention to 

provide a storage medium which stores a control 
program capable of smoothly controlling an image 
sensing apparatus of the present invention. 

It is still another object of the present 
15 invention to allow a camera or the like which uses 

multiple speed zooming from low-speed zooming to high- 
speed zooming to make the focal plane accurately track 
an object to be photographed during zooming operation 
regardless of zoom the speeds . 
20 It is still another object of the present 

invention to make the focal plane accurately track an 
object to be photographed during zooming operation in 
accordance with the presence /absence of internal noise 
such as noise resulting from camera shakes which are 
25 likely to occur during low-speed zooming or another 
factor . 
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In order to solve the above problems and achieve 
the above objects, an image sensing method according 
to its first aspect of the present invention is 
characterized by the following arrangement. 
5 The method comprises the zooming step of 

performing zooming operation, the shutter speed 
control step of controlling a timing of a charge 
storage time of an image sensing element, and the 
control step of controlling to change a zoom speed in 
10 the zooming step in accordance with a shutter speed. 

An image sensing apparatus according to its 
first aspect of the present invention is characterized 
by the following arrangement. 

The apparatus comprises zooming means for 
15 performing zooming operation, shutter speed control 
means for controlling a timing of a charge storage 
time of an image sensing element, and control means 
for controlling to change a zoom speed of the zooming 
means in accordance with a shutter speed. 
20 An image sensing method according to its second 

aspect of the present invention is characterized by 
the following arrangement. 

The method comprises the zooming step of 
perfoirming zooming operation using a zoom lens, the 
25 focus adjustment step of correcting movement of a 

focal plane upon movement of the zoom lens by using a 
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focus lens, the driving step of independently moving 
the zoom lens and the focus lens parallel to an 
optical axis, the selection step of selecting a charge 
storage time of an image sensing element, the shutter 
5 speed control step of controlling a timing of the 

charge storage time of the image sensing element, and 
the control step of controlling to change a zoom speed 
in the zooming step in accordance with a shutter speed. 
An image sensing apparatus according to its 
10 second aspect of the present invention is 

characterized by the following arrangement. 

The apparatus comprises zooming means for 
performing zooming operation using a zoom lens, focus 
adjustment means for correcting movement of a focal 
15 plane upon movement of the zoom lens by using a focus 
lens, driving means for independently moving the zoom 
lens and the focus lens parallel to an optical axis, 
an image sensing element, selection means for 
selecting a charge storage time of the image sensing 
20 element, shutter speed control means for controlling a 
timing of the charge storage time of the image sensing 
element, and control means for controlling to change a 
zoom speed of the zooming means in accordance with a 
shutter speed. 

25 A storage medium according to its first aspect 

of the present invention is characterized by the 
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following arrangement. 

The storage medium stores a control program for 
controlling an image sensing apparatus including 
zooming means for performing zooming operation, 
5 shutter speed control means for controlling a timing 
of a charge storage time of an image sensing element, 
and control means for controlling a zoom speed of the 
zooming means, wherein the control program has a 
control module for the step of controlling to change 
10 the zoom speed of the zooming means in accordance with 
a shutter speed. 

A storage medium according to its second aspect 
of the present invention is characterized by the 
following arrangement. 
15 The storage medium stores a control program for 

controlling an image sensing apparatus comprising 
zooming means for performing zooming operation using a 
zoom lens, focus adjustment means for correcting 
movement of a focal plane upon movement of the zoom 
20 lens by using a focus lens, driving means for 

independently moving the zoom lens and the focus lens 
parallel to an optical axis, an image sensing element, 
selection means for selecting a charge storage time of 
the image sensing element, shutter speed control means 
25 for controlling a timing of the charge storage time of 
the image sensing element, and control means for 



controlling a zoom speed of the zooming means, wherein 
the control program has a control module for the step 
of controlling to change the zoom speed of the zooming 
means in accordance with a shutter speed. 
5 An image sensing apparatus according to its 

third aspect of the present invention is characterized 
by the following arrangement. 

The apparatus having an arrangement which can 
maintain an in-focus state by correcting a 

10 displacement of a focal plane during zooming operation 
comprises signal detection means for extracting a 
high-frequency component from a video signal obtained 
by photographing an object, and detecting a sharpness 
signal, zoom speed detection means for detecting a 

15 speed of the zooming operation, and evaluation value 

calculation means for changing a time during which the 
sharpness signals are averaged, during the zooming 
operation, in accordance with the speed of the zooming 
operation, and calculating a focus evaluation value 

20 during the zooming operation in the set averaging time. 
An image sensing apparatus according to its 
fourth aspect of the present invention is 
characterized by the following arrangement. 

The apparatus having an arrangement which can 

25 maintain an in-focus state by correcting a 

displacement of a focal plane during zooming operation 
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comprises signal detection means for extracting a 
high-frequency component from a video signal obtained 
by photographing an object, and detecting a sharpness 
signal, signal extraction means for extracting a 
5 luminance signal from the video signal obtained by 
photographing the object, and evaluation value 
calculation means for changing a time during which the 
sharpness signals are averaged, during the zooming 
operation, in accordance with an object illuminance 

10 obtained from the luminance signal, and calculating a 
focus evaluation value during the zooming operation in 
the set averaging time. 

An image sensing apparatus according to its 
fifth aspect of the present invention is characterized 

15 by the following arrangement. 

The apparatus having an arrangement which can 
maintain an in-focus state by correcting a 
displacement of a focal plane during zooming operation 
comprises signal detection means for extracting a 

20 high-frequency component from a video signal obtained 
by photographing an object, and detecting a sharpness 
signal, shake detection means for detecting a shake of 
the image sensing apparatus, and evaluation value 
calculation means for changing a time during which the 

25 sharpness signals are averaged, during the zooming 
operation, in accordance with information from the 
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shake detection means, and calculating a focus 
evaluation value during the zooming operation in the 
set averaging time . 

An image sensing apparatus according to its 
5 sixth aspect of the present invention is characterized 
by the following arrangement. 

The apparatus comprises a first lens group for 
zooming operation, a second lens group for correcting 
movement of a focal plane during movement of the first 
10 lens group, signal detection means for extracting a 

high-frequency component from a video signal obtained 
by photographing an object, and detecting a sharpness 
signal, zoom speed detection means for detecting a 
speed of the zooming operation, storage means for 
15 storing information of a focus position of the second 
lens group relative to a position of the first lens 
group in correspondence with an object distance, 
moving speed calculation means for obtaining a 
standard moving speed of the second lens group upon 
20 movement of the first lens group on the basis of the 
information stored in the storage means, speed 
addition means for adding a correction speed to the 
standard moving speed of the second lens group, 
obtained by the moving speed calculation means, during 
25 the zooming operation, and focus control means for 

changing a time during which the sharpness signals are 
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averaged, during the zooming operation, in accordance 
with the speed of the zooming operation, calculating a 
focus evaluation value during the zooming operation in 
the set averaging time, and changing the correction 
5 speed to be added to the standard moving speed in 
accordance with a magnitude of the calculated focus 
evaluation value. 

An image sensing apparatus according to its 
seventh aspect of the present invention is 
10 characterized by the following arrangement. 

The apparatus comprises a first lens group for 
zooming operation, a second lens group for correcting 
movement of a focal plane during movement of the first 
lens group, signal detection means for extracting a 
15 high-frequency component from a video signal obtained 
by photographing an object, and detecting a sharpness 
signal, signal extraction means for extracting a 
luminance signal from the video signal obtained by 
photographing the object, storage means for storing 
20 information of a focus position of the second lens 

group relative to a position of the first lens group 
in correspondence with an object distance, moving 
speed calculation means for obtaining a standard 
moving speed of the second lens group upon movement of 
25 the first lens group on the basis of the information 
stored in the storage means, speed addition means for 
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adding a correction speed to the standard moving speed 
of the second lens group, obtained by the moving speed 
calculation means, during the zooming operation, and 
focus control means for changing a time during which 
5 the sharpness signals are averaged, during the zooming 
operation, in accordance with an object illuminance 
obtained from the luminance signal, calculating a 
focus evaluation value during the zooming operation in 
the set averaging time, and changing the correction 
10 speed to be added to the standard moving speed in 
accordance with a magnitude of the calculated focus 
evaluation value . 

An image sensing apparatus according to its 
eighth aspect of the present invention is 
15 characterized by the following arrangement. 

The apparatus comprises a first lens group for 
zooming operation, a second lens group for correcting 
movement of a focal plane during movement of the first 
lens group, signal detection means for extracting a 
20 high-frequency component from a video signal obtained 
by photographing an object, and detecting a sharpness 
signal, shake detection means for detecting a shake of 
the image sensing apparatus, storage means for storing 
information of a focus position of the second lens 
25 group relative to a position of the first lens group 
in correspondence with an object distance, moving 
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speed calculation means for obtaining a standard 
moving speed of the second lens group upon movement of 
the first lens group on the basis of the information 
stored in the storage means, speed addition means for 
5 adding a correction speed to the standard moving speed 
of the second lens group, obtained by the moving speed 
calculation means, during the zooming operation, and 
focus control means for changing a time during which 
the sharpness signals are averaged, during the zooming 

10 operation, in accordance with information from the 

shake detection means, calculating a focus evaluation 
value during the zooming operation in the set 
averaging time, and changing the correction speed to 
be added to the standard moving speed in accordance 

15 with a magnitude of the calculated focus evaluation 
value . 

A lens control method according to its first 
aspect of the present invention is characterized by 
the following arrangement. 

20 The method is used in an image sensing apparatus 

including a first lens group for zooming operation and 
a second lens group for correcting movement of a focal 
plane during movement of the first lens group and 
adapted to control movement of the second lens group 

25 so as to maintain an in-focus state by correcting a 
displacement of a focal plane upon movement of the 
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first lens group during zooming operation, comprising 
the steps of averaging sharpness signals corresponding 
to a predetermined time, each generated by extracting 
a high-frequency component from a video signal 
5 obtained by photographing an object, and calculating a 
focus evaluation value for determining a moving speed 
of the second lens group on the basis of the averaged 
sharpness signal, and changing the averaging time of 
the sharpness signals during the zooming operation in 

10 accordance with a speed of the zooming operation. 

A lens control method according to its second 
aspect of the present invention is characterized by 
the following arrangement. 

The method is used in an image sensing apparatus 

15 including a first lens group for zooming operation and 
a second lens group for correcting movement of a focal 
plane during movement of the first lens group and 
adapted to control movement of the second lens group 
so as to maintain an in-focus state by correcting a 

20 displacement of a focal plane upon movement of the 

first lens group during zooming operation, comprising 
the steps of averaging sharpness signals corresponding 
to a predetermined time, each generated by extracting 
a high-frequency component from a video signal 

25 obtained by photographing an object, and calculating a 
focus evaluation value for determining a moving speed 
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of the second lens group on the basis of the averaged 
sharpness signal, and changing the averaging time of 
the sharpness signals during the zooming operation in 
accordance with an object illuminance obtained from a 
5 luminance signal in the video signal obtained by- 
photographing the object. 

A lens control method according to its third 
aspect of the present invention is characterized by 
the following arrangement. 

10 The method is used in an image sensing apparatus 

including a first lens group for zooming operation and 
a second lens group for correcting movement of a focal 
plane during movement of the first lens group and 
adapted to control movement of the second lens group 

15 so as to maintain an in- focus state by correcting a 
displacement of a focal plane upon movement of the 
first lens group during zooming operation, comprising 
the steps of averaging sharpness signals corresponding 
to a predetermined time, each generated by extracting 

20 a high-frequency component from a video signal 

obtained by photographing an object, and calculating a 
focus evaluation value for determining a moving speed 
of the second lens group on the basis of the averaged 
sharpness signal, and changing the averaging time of 

25 the sharpness signals during the zooming operation in 
accordance with information from shake detection means 
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for detecting a shake of the image sensing apparatus. 

Other objects and advantages besides those 
discussed above shall be apparent to those skilled in 
the art from the description of a preferred embodiment 
5 of the invention which follows. In the description, 

reference is made to accompanying drawings, which form 
a part hereof, and which illustrate an example of the 
invention. Such example, however, is not exhaustive of 
the various embodiments of the invention, and 
10 therefore reference is made to the claims which follow 
the description for determining the scope of the 
invention. 



BRIEF DESCRIPTION OF THE DRAWINGS 
15 Fig. 1 is a block diagram showing the 

arrangement of an image sensing apparatus according to 
the first embodiment of the present invention; 

Fig. 2 is a flow chart showing a procedure for 
lens control operation in the image sensing apparatus 
20 according to the first embodiment of the present 
invention; 

Fig. 3 is a flow chart showing a procedure for 
lens control operation in the image sensing apparatus 
according to the first embodiment of the present 
25 invention; 

Fig. 4 is a graph showing the relationship 



between the focus lens position and the zoom lens 
position; 

Fig. 5 is a view showing the arrangement of an 
inner focus type lens system in a conventional image 
5 sensing apparatus; 

Fig. 6 is a graph showing the relationship 
between the focus lens position and the focal length 
(zoom lens position) ; 

Fig. 7 is a graph showing the in- focus locus 
10 (cam locus) of the focus lens at movement of the zoom 
lens for each object distance; 

Fig. 8 is a view showing how the cam locus 
information in Fig. 7 is stored in a lens control 
microcomputer (or external memory) ; 
15 Fig. 9 is a view showing the relationship 

between the focus lens position and the zoom lens 
position; 

Figs. lOA and lOB are graphs for explaining an 
example of conventional locus tracking methods; 
20 Figs . IIA and llB are timing charts showing the 

relationship between shutter speeds and video signals; 

Figs . 12A to 12D are timing charts showing the 
relationship between shutter speeds and signals; 
Fig. 13 is a block diagram showing the 
25 arrangement of an image sensing apparatus according to 
the third to fifth embodiments of the present 



invention; 

Figs . 14A and 14B are views respectively showing 
the arrangement and characteristics of a zoom switch; 

Fig. 15 is a flow chart showing a procedure for 
5 control operation performed by an AF microcomputer 
according to the third to sixth embodiments; 

Fig. 16 is a flow chart showing a procedure for 
control operation performed by the AF microcomputer 
according to the third embodiment, and more 
10 specifically, processing for the zooming routine in 
Fig. 15; 

Fig. 17 is a flow chart showing a procedure for 
control operation performed by an AF microcomputer 
according to the fourth embodiment, and more 
15 specifically, processing for the zooming routine in 
Fig. 15; 

Fig. 18 is a flow chart showing a procedure for 
control operation performed by an AF microcomputer 
according to the fifth embodiment, and more 
20 specifically, processing for the zooming routine in 
Fig. 15; 

Fig. 19 is a block diagram showing the 
arrangement of an image sensing apparatus according to 
the sixth embodiment of the present invention; and 
25 Fig. 20 is a flow chart showing a procedure for 

control operation performed by an AF microcomputer 



according to the sixth embodiment, and more 
specifically, processing for the zooming routine in 
Fig. 15. 



5 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Each embodiment of the present invention will be 
described below with reference to the accompanying 
drawings . 
(First Embodiment) 

10 The first embodiment of the present invention 

will be described first with reference to Figs. 1 to 4 . 

Fig. 1 is a block diagram showing the 
arrangement of an image sensing apparatus according to 
the first embodiment of the present invention. 

15 Referring to Fig. 1, reference symbol LS denotes an 
inner focus type lens system. This lens system LS 
includes the following constituent elements: a 
stationary first lens group 101, a zoom lens (first 
lens group) 102 for optical zooming, a stop 103 for 

20 light amount adjustment, a stationary second lens 

group 104, and a focus lens (second lens group) 105 
having both a compensation function and a focusing 
function. Video light transmitted through the lens 
system LS forms an image on the surface of an image 

25 sensing element 106 (to be described later) to be 
photoelectrically converted into a video signal. 
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Reference numeral 10 6 denotes an image sensing 
element (CCD) for converting a light signal into an 
electrical signal; 107, a first amplifier (or 
impedance converter) for amplifying the video signal 
5 output from the image sensing element 106; 108, a 
camera signal processing circuit for performing 
predetermined processing for the video signal output 
from the image sensing element 106; 109, a second 
amplifier for amplifying the video signal processed by 

10 the camera signal processing circuit 108 to a 

predetermined level; 110, an LCD control circuit for 
controlling a display {LCD: Liquid Crystal Display) 
(to be described later) ; and 111, a display (LCD: 
Liquid Crystal Display) for displaying information. 

15 Reference numeral 112 denotes a stop control 

circuit; 113, an IG driver; 114, an IG meter; 115, an 
AF evaluation value processing circuit; and 116, a 
distance measuring frame generating circuit. The video 
signal amplified by the first amplifier 107 is sent to 

20 the stop control circuit 112 and the AF evaluation 

value processing circuit 115. The stop control circuit 
112 drives the IG driver 113 and the IG meter 114 to 
control the stop 103 in accordance with the video 
signal input level, thereby performing light amount 

25 adjustment. The AF evaluation value processing circuit 
115 extracts a high-frequency component from a 



- 31 - 



liaminance signal within the distance measuring frame 
in accordance with a gate signal from the distance 
measuring frame generating circuit 116. 

Reference numeral 117 denotes a lens control 
5 microcomputer for performing drive control of the lens 
and distance measuring control for a change of the 
distance measuring area in accordance with the 
strength of an AF evaluation signal. In addition, the 
lens control microcomputer 117 communicates with a 

10 system control microcomputer (system controller) 118 
to exchange information from a zoom switch (zoom SW) 
119, which is read by the system controller 118 upon 
A/D conversion or the like, and zooming information 
such as a zoom direction and a focal length in zooming 

15 operation controlled by the lens control microcomputer 
117. The zoom SW 119 takes the form of a unit. A 
voltage corresponding to the rotational angle of an 
operation member (not shown) is output from the zoom 
SW 119 . Variable speed zooming is performed in 

20 accordance with this output voltage. 

Reference numeral 120 denotes a zoom motor for 
driving the zoom lens 102; 121, a focus motor for 
driving the focus lens 105; 122, a zoom driver for 
outputting driving energy to the zoom motor 12 0 in 

25 accordance with a drive instruction output for the 

zoom lens 102 from the lens control microcomputer 117; 
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and 123, a focus driver for outputting driving energy 
to the zoom driver 122 in accordance with a drive 
instruction output for the focus lens 105 from the 
lens control microcomputer 117 . 
5 Reference numeral 124 denotes a shutter speed 

selector for selecting the shutter speed; 125, a 
shutter speed controller for controlling the shutter 
speed; and 12 6, a CCD driving circuit for driving the 
image sensing element 105. 

10 The shutter speed data selected by the shutter 

speed selector 124 is input to the shutter speed 
controller 125 to set the charge storage time for the 
image sensing element 106 in accordance with the 
shutter speed. The charge storage timing data for the 

15 image sensing element 10 6 controlled by the shutter 
speed controller 12 5 is input to the camera signal 
processing circuit 108 and the lens control 
microcomputer 117 . 

A method of driving the zoom motor 120 and the 

20 focus motor 121 will be described next, assuming that 
these motors are stepping motors . 

The lens control microcomputer 117 determines 
the driving speeds for the zoom motor 120 and the 
focus motor 121 by program processing, and sends the 

25 speeds as rotational frequency signals for the motors 
12 0 and 121 to the zoom driver 122 and the focus 
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driver 123, respectively. The lens control 
microcomputer 117 also sends drive/stop instruction 
signals and rotating direction instruction signals for 
the motors 120 and 121 to the drivers 122 and 123. 
5 The drive/stop instruction signal and rotating 

direction instruction signal for the zoom motor 12 0 
mainly correspond to the state of the zoom SW 119. 
Such signals for the focus motor 121 correspond to 
drive instructions determined within the lens control 

10 microcomputer 117 in AF (Automatic Focus) processing 
and zooming. Each of the drivers 122 and 123 sets the 
four motor exciting phases to forward and reverse 
rotation phases in accordance with the rotating 
direction instruction signal, and outputs voltages 

15 (currents) for the four motor exciting phases while 
changing them in accordance with the received 
rotational frequency signal, thereby ON/OFF- 
controlling the output to each of the motors 12 0 and 
121 in accordance with the drive/stop instruction 

20 signal while controlling the rotating direction and 

rotational frequency of each of the motors 12 0 and 121. 

The operation of the image sensing apparatus 
according to this embodiment will be described next 
with reference to Fig. 2, 

25 Fig. 2 is a flow chart showing a procedure 

followed by the image sensing apparatus according to 



- 34 - 



this embodiment. The control flow chart shown in 
Fig. 2 is processed in the lens control microcomputer 
117. 

Step S201 is an initialization routine, in which 
5 a RAM (Random- Access Memory) and various types of 
ports in the lens control microcomputer 117 are 
initialized. Step S202 is a communication routine, in 
which information from the zoom SW 119 and zooming 
information such as the position of the zoom lens 102 

10 are exchanged. Step S203 is a sharpness signal 

processing routine, in which the sharpness signal of 
an AF evaluation signal is processed in accordance 
with the signal obtained from the AF evaluation value 
processing circuit 115. Step S204 is an AF processing 

15 routine, in which automatic focus adjustment is 
performed in accordance with a change in the AF 
evaluation signal. 

Step S2 05 is a zooming routine, which is a 
compensation processing routine for maintaining an in- 

20 focus state in zooming operation. In this routine, the 
driving direction and speed for the focus lens 105 are 
calculated so as to trace a cam locus like the one 
shown in Fig. 6. This calculation method will be 
described in detail later. Step S2 06 is a driving 

25 direction and speed selection routine, in which 

driving directions and speeds to be used are selected 
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from those calculated for the zoom lens 102 and focus 
lens 105 in steps S204 and S205 in accordance with the 
AF (Automatic Focus) mode, zooming operation, or the 
like so as to prevent the lenses from exceeding the 
5 telephoto end, wide-angle end, closest focusing 

distance, and infinity, which are set by software, 
thereby preventing the lenses from bumping against the 
lens mechanical ends . 

Step S2 07 is a routine for performing drive 

10 control on the zoom motor 120 and the focus motor 121. 
In this routine, control signals are output to the 
zoom motor 12 0 and the focus motor 121 in accordance 
with the data selected in step S206, thereby 
controlling the driving/ stopping of the zoom lens 102 

15 and the focus lens 105. Upon completion of the 

processing in step S207, the flow returns to step S202. 

A series of operations in Fig. 2 is executed in 
synchronism with a vertical sync period (a standby 
state continues until the next vertical sync signal 

20 arrives in the processing in step S202) . 

The zooming routine in step S205 in Fig. 2 will 
be described in detail next with reference to Fig. 3. 

Fig. 3 is a flow chart showing a procedure for 
the zooming routine in step S205 in Fig. 2. 

25 When the AF processing routine in step S204 in 

Fig. 2 is complete, the zoom speed is set in 



accordance with information from the zoom SW 119, 
which is obtained upon communication with the system 
controller 118, and a reverse flag is set to 0 in step 
S3 01 in Fig. 3. In step S3 02, it is checked, on the 
5 basis of information from the shutter speed selector 
124 in Fig. 1, whether the shutter speed is higher 
than a given speed SP. If YES in step S302, it is 
checked in step S3 03 whether zooming is being 
performed. If YES in step S303, a standard cam locus 

10 is set from the positions of the zoom lens 102 and 
focus lens 105 at this time and a stored 
representative cam table to zoom in step S3 04. 

Referring to Fig. 7, letting pO be the current 
position, the ratio obtained by internally dividing a 

15 line segment bO - a{P) with pO is given by 
pO - aO/bO - aO = a/P 
Referring to Fig. 8, since aO = A(0, 0) and bO = A(l, 
0) , a locus is obtained by connecting points that 
internally divide the distance defined by n = 0, 1 

20 with V = 0 at the ratio of a/(3 from the wide-angle 
side to the telephoto side (v=0, 1,..., s). A 
standard cam locus can therefore be set by calculating 
n, a, and P from the positions of the zoom lens 102 
and focus lens 105 at this time. A point pi is then 

25 calculated from the standard cam locus (n, a, P) and 
the locus data stored in the lens control 
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microcomputer 117 according to equation (1) described 
in the prior art. A standard tracking speed VfO of the 
focus lens 105 is calculated by using the point pi. 

In step S3 05, correction speeds Vf+ and Vf- at 
5 which the focus lens 105 is driven in the + and - 

directions in Figs. lOA and lOB are calculated. These 
correction speeds Vf+ and Vf- are calculated as 
follows . 

Fig. 4 is a graph for explaining a method of 

10 calculating the correction speeds Vf+ and Vf-. 

Referring to Fig. 4, the ordinates indicates the 
position of the focus lens 105; and the abscissa, the 
position of the zoom lens 102. 

Referring to Fig. 4, reference numeral 1004 

15 denotes a cam locus to be traced. Assume that the 

focusing speed set when the position of the focus lens 
105 changes by a value y as the position of the zoom 
lens 102 changes by a value x is the standard speed 
VfO (denoted by reference numeral 403 in Fig. 4) , and 

20 the focusing speeds set when the position of the focus 
lens 105 changes by values n and m as the position of 
the zoom lens 102 changes by the value x are 
respectively the correction speeds Vf+ and Vf- to be 
obtained. In this case, the values n and m are 

25 determined such that a speed 401 in Fig. 4, which is 
obtained by adding the correction speed Vf+ to the 
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standard speed VfO and is used to drive the lens in 
the + direction, and a speed 402 in Fig. 4, which is 
obtained by adding the correction speed Vf- to the 
standard speed VfO and is used to drive the lens in 
the - direction, respectively have direction vectors 
separated from the direction vector of the standard 
speed VfO by an equal angle 7. 

First of all, the value n and m are obtained. 
From the graph of Fig. 4, we have: 

tane = y/x, tan (6 - y) = (y - m) /x, tan (9 + 7) 
= (y +n) /X ... (2) 

tan (6 ± 7) = (tane»tan7) / (l±tane«tan7) ...(3) 

According to equations (2) and {3}, 
m = (x2 + y2)/(x/K + y} ...{4) 
n = (x2 + y2)/(x/k - y) ...{5) 

for tan7 k 
The values n and m are calculated according to 
equations (2) and (3). 

If the position of the zoom lens 102 changes by 
the value x per unit time, the respective values can 
be defined as follows: zoom speed vz = x, standard 
focusing speed VfO = y, correction speed Vf+ = n, and 
correction speed Vf- = m. The correction speeds Vf+ 
and Vf- can be obtained from equations (4) and (5) . 

Referring to Fig. 3 again, it is checked in step 
S3 06 whether zooming is from the wide-angle side (W) 
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to the telephoto side (T) . If YES in step S3 06, it is 
checked in step S307 whether the current sharpness 
integral signal level is lower than a minimum value 
(THl) . If YES in step S307, the reverse flag is set at 
5 1 in step S308. It is then checked in step S309 

whether the reverse flag is set at 1 . If YES in step 
S3 09, it is checked in step S3 10 whether a correction 
flag is set at 1 . If YES in step S310, the correction 
flag is set at 0 (- direction) in step S311. 
10 focusing speed Vf ^ VfO - Vf- (VfO > 0) 

= VfO + Vf- (VfO < 0) 

for Vf- > 0 

After a speed vf2 is set for the focus motor 121 
in step S312, the zoom motor 120 and the focus motor 
15 121 are actually driven in steps S206 and S207 in 
Fig. 2. 

If it is determined in step S3 02 that the 
shutter speed is lower than the speed SP, the zoom 
speed set in step S3 01 is changed to a low speed in 

20 step S313, and the flow advances to step S303. If it 
is determined in step S3 03 that zooming is not being 
performed, the processing in Fig. 3 is terminated, and 
the zoom motor 120 and the focus motor 121 are 
actually driven in steps S2 0 6 and S2 07 in Fig. 2. 

25 If it is determined in step S306 that zooming is 

not from the wide-angle side (W) to the telephoto side 
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(T) , correction speed Vf+ = 0 and Vf- - 0 are set in 
step S314, and the flow advances to step S309. If it 
is determined in step S3 07 that the current sharpness 
integral signal level is equal to or higher than the 
5 minimum value (THl) , the flow advances to step S309. 
If it is determined in step S3 09 that the 
reverse flag is not at 1, it is checked in step S3 15 
whether the correction flag is at 1. If NO in step 
S3 15 or S3 10, the correction flag is set at 1 (+ 
10 direction) in step S316. 

focusing speed Vf = VfO + Vf+ (VfO > 0) 
= VfO - Vf+ (VfO < 0) 

for Vf + > 0 

When the processing in step S316 is complete, 
15 the flow advances to step S312. 

As described above, when the focus position is 
unknown, and zooming is performed while the AF 
evaluation value is increased/decreased, the focus 
tracking performance at a low shutter speed, i.e., a 
20 speed lower than the normal shutter speed of 1/60 sec, 
can be improved by decreasing the zoom speed below the 
normal zoom speed. 
(Second Embodiment) 

The second embodiment of the present invention 
25 will be described next. 

As shown in Figs. IIA to 12D, at a shutter speed 



of 1/60 sec or higher, a sharpness signal can be 
obtained every vertical sync period. At 1/30 sec, 
however, a sharpness signal is obtained every two 
vertical sync periods, and at 1/15 sec, a sharpness 
5 signal is obtained every four vertical sync periods. 
That is, as the shutter speed decreases, the period at 
which a sharpness signal is obtained is prolonged. If 
the time required for zooming (zoom speed) from the 
wide-angle side to the telephoto side remains the same, 

10 the AF evaluation (sharpness signal) obtained during 

zooming from the telephoto side to the wide-angle side 
decreases as the shutter speed decreases. When, 
therefore, the shutter speed is low, the same focus 
tracking performance during zooming as that at a high 

15 shutter speed can be obtained by decreasing the zoom 
speed in proportion to the shutter speed. 

If, therefore, it is determined in step S3 02 in 
Fig. 3 that the shutter speed is lower than a given 
speed SP, zooming operation that can track an object 

20 without blur can be performed, regardless of how low 
the shutter speed is, by setting the zoom speed in 
accordance with the shutter speed instead of resetting 
the zoom speed to a low speed. 

As described in detail above, according to the 

25 first and second embodiments, by determining the zoom 
speed in accordance with the shutter speed, object 
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focus tracking can be performed during zooming 
regardless of the shutter speed. 

In addition, when the shutter speed is lower 
than the normal speed, the object focus tracking 
5 performance during zooming can be improved by 
decreasing the zoom speed. 

Furthermore, according to storage media of the 
first and second embodiments, an image sensing 
apparatus like the one described above can be smoothly 

10 controlled. 

(Third Embodiment) 

Fig. 13 is a block diagram showing the 
arrangement of an image sensing apparatus according to 
the third embodiment of the present invention. 

15 Referring to Fig. 13, reference numerals 601, 602, 603, 
604, and 605 respectively denote the building elements 
of an inner focus type lens system, and more 
specifically, a stationary front-element lens group, a 
second lens group for zooming, a stop, a third 

20 stationary lens group, and a fourth lens group having 
both a compensation function and a focusing function. 

Object light transmitted through this lens 
system forms an image on an image sensing element 606 
such as a CCD and photoelectrically converted into a 

25 video signal. This video signal is amplified by an 
amplifier or impedance converter 607 and input to a 
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camera signal processing circuit 608. The video signal 
having undergone predetermined signal processing is 
amplified to a prescribed level by an amplifier 609 
and processed by an LCD display circuit 610. The 
5 resultant signal is displayed as a photographic image 
on an LCD 611. 

The video signal amplified by the amplifier or 
impedance converter 607 is also sent to a stop control 
circuit 612 and an AF evaluation value processing 

10 circuit 615. The stop control circuit 612 drives an IG 
driver 613 and an IG meter 614 to control the stop 603 
in accordance with the input level of the video signal, 
thereby adjusting the light amount. The AF evaluation 
value processing circuit 615 extracts only the high- 

15 frequency component from the video signal within a 
distance measuring frame in accordance with a gate 
signal from a distance measuring frame generating 
circuit 617, and performs predetermined processing to 
generate an AF evaluation signal. 

20 Reference numeral 616 denotes an AF 

microcomputer for performing lens drive control and 
distance measuring frame control to change the 
distance measuring area in accordance with the 
strength of the AF evaluation signal supplied from the 

25 AF evaluation value processing circuit 615. In 

addition, the AF microcomputer 616 communicates with a 



system control microcomputer (system controller) 622 
to exchange information from a zoom switch 623, which 
is loaded into the system controller 622 upon A/D 
conversion or the like, zooming information such as a 
5 zoom direction and focal length in zooming controlled 
by the AF microcomputer 616, and the like. 

The above zoom switch 623 takes the form of a 
unit. A voltage corresponding to the rotational angle 
of an operation member is output from the zoom SW 119. 

10 Figs. 14A and 14B respectively show the arrangement of 
the zoom SW as a unit and its characteristics. As 
shown in Fig. 14A, the zoom switch 623 is comprised of 
a variable resistor to output a voltage in accordance 
with the rotational angle of the operation member. 

15 Variable speed zooming is done in accordance with the 
magnitude of this output voltage. 

Fig. 14B shows the relationship between the 
output voltage from the zoom SW and the variable zoom 
speed. Within the output voltage range, a zooming 

20 stopping zone is located near 2.5 V, i.e., the middle 
voltage. When the output voltage is lower than this 
voltage, zooming is performed in the wide-angle 
direction. The zoom speed increases with a decrease in 
the output voltage, and vice versa. When the output 

25 voltage is higher than the stopping voltage, zooming 
is performed in the telephoto direction. The zoom 
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speed increases with an increase in the output voltage, 
and vice versa. The output voltage and the zoom speed 
have a linear relationship in both the wide-angle and 
telephoto directions . 

Reference numeral 618 denotes a zoom lens driver 
for outputting driving energy to the lens driving 
motor in accordance with a drive instruction for the 
zoom lens 602 which is output from the AF 
microcomputer 516; 621, a focus compensation lens 
driver for outputting driving energy to the lens 
driving motor in accordance with a driving instruction 
for the focus lens 605 which is output from the AF 
microcomputer 616; and 619 and 620, lens driving 
motors for driving the zoom lens 602 and the focus 
lens 605. 

A method of driving the motors will be described 
below, assuming that the lens driving motors are 
stepping motors . 

The AF microcomputer 616 determines the driving 
speeds for the zoom lens motor 619 and the focus 
compensation lens motor 621 by program processing, and 
sends the speeds as rotational frequency signals for 
the respective stepping motors to the zoom lens driver 
618 and the focus compensation lens driver 62 0, 
respectively. The AF microcomputer 616 also sends 
drive/stop instructions and rotating direction 



instructions for the motors 619 and 621 to the drivers 
618 and 620. 

The drive/stop instruction and rotating 
direction instruction for the zoom lens motor 619 are 
5 output mainly in accordance with the state of the zoom 
switch unit 623. Such signals for the focus 
compensation lens motor 621 are output in accordance 
with drive instructions determined within the AF 
microcomputer 616 in AF processing and zooming. Each 

10 motor driver sets the four motor exciting phases to 

forward and reverse rotation phases in accordance with 
the received rotating direction signal, and outputs 
voltages (currents) for the four motor exciting phases 
while changing them in accordance with the received 

15 rotational frequency signal, thereby ON/OFF- 

controlling the output to each motor in accordance 
with the drive/stop instruction while controlling the 
rotating direction and rotational frequency of each 
motor . 

20 Fig. 15 is a flow chart showing a procedure for 

executing the third embodiment. This processing is 
performed in the AF microcomputer 616. Step S701 is an 
initialization routine, in which a RAM and various 
types of ports (not shown) in the AF microcomputer 616 

25 are initialized. Step S702 is a communication routine, 
in which information from the zoom SW unit 623 and 
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zooming information such as a zoom lens position are 
exchanged . 

Step S7 03 is a sharpness signal processing 
routine, in which the sharpness signal of an AF 
5 evaluation signal is processed in accordance with the 
signal obtained from the AF evaluation value 
processing circuit 615. Step S704 is an AF processing 
routine, in which automatic focus adjustment is 
performed in accordance with a change in the AF 

10 evaluation signal processed in step S703 . 

Step S7 05 is a zooming routine, in which 
compensation processing is performed to maintain an 
in-focus state in zooming operation. In this routine, 
the driving direction and speed for the focus lens 605 

15 are calculated to trace a cam locus like the one shown 
in Fig. 6. This operation will be described in detail 
later with reference to Fig. 16. 

In step S70 6, driving directions and speeds to 
be used are selected from those calculated for zooming 

20 and focusing in steps S704 and S705 in accordance with 
the AF mode, zooming operation, or the like so as to 
prevent the lenses from exceeding the telephoto end, 
wide-angle end, closest focusing distance, and 
infinity, which are set by software, thereby 

25 preventing the lenses from overshooting the lens 
mechanical ends . 
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In step S707, control signals are output to the 
zoom lens driver 618 and the focus compensation lens 
driver 62 0 in accordance with the information about 
the driving directions and speeds for focusing which 
5 are determined in step S7 06, thereby controlling the 

driving/ stopping of the lenses. The control returns to 
step S702 after step S707 . A series of operations in 
Fig. 15 is executed in synchronism with the vertical 
sync period (a standby state continues until the next 
10 vertical sync signal arrives in the processing in step 
S702) . 

Fig. 16 is a flow chart showing a procedure for 
executing the third embodiment, and more specifically, 
the contents of the processing in the subroutine in 
15 step S705 in Fig. 15. 

First of all, in step S801, the zoom speed is 
set on the basis of the information from the zoom 
switch 623, which is obtained upon communication with 
the system controller 622, and a reverse flag is set 
20 to "0". It is then checked in step S802 whether 

zooming is being performed. If NO in step S802, the 
flow goes out of the zooming routine. 

If it is determined in step S802 that zooming is 
being performed, the flow advances to step S803 to 
25 determine the standard cam locus on the basis of the 
positions of the zoom lens 602 and focus lens 605 at 



this time and the contents of a representative cam 
locus table stored in advance. Referring to Fig. 7, 
letting pO be the current position of the focus lens 
605, the ratio obtained by internally dividing a line 
5 segment bO - aO(P) with a point pO is given by 
pO - aO/bO - aO = a/p 
Referring to Fig. 8, since aO = AOO and bO = AlO, a 
locus is obtained by connecting points that internally 
divide the distance defined by n = 0 , 1 with v = 0 at 

10 the ratio of a/P from the wide-angle side to the 

telephoto side (v=0, 1,..., s). A standard cam locus 
can therefore be set by calculating n, a, and P from 
the positions of the zoom lens 602 and focus lens 605 
at this time. A point pi is then calculated from the 

15 standard cam locus (n, a, p) and the locus data stored 
in the AF microcomputer 616 according to equation (1) 
described in the prior art. A standard tracking speed 
VfO of the focus lens 605 is calculated by using the 
point pi . 

20 In step S804, correction speeds Vf+ and Vf- at 

which the focus lens 605 is driven in the + and - 
directions in Fig. lOB are calculated. These 
correction speeds Vf+ and Vf- are calculated as 
follows . 

25 As described above in the first embodiment. 

Fig. 4 is a graph for explaining a method of 
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calculating the correction speeds Vf + and Vf- . 
Referring to Fig. 4, the ordinates indicates the 
position of the focus lens; and the abscissa, the 
position of the zoom lens. Reference numeral 1004 
5 denotes a cam locus to be traced. 

Assume that the focusing speed set when the 
position of the focus lens 605 changes by a value y as 
the position of the zoom lens 602 changes by a value x 
is the standard speed VfO (403), and the focusing 

10 speeds set when the position of the focus lens 605 

changes by values n and m as the position of the zoom 
lens 602 changes by the value x are respectively the 
correction speeds Vf+ and Vf- to be obtained. In this 
case, the values n and m are determined such that a 

15 speed 401, which is obtained by adding the correction 
speed Vf+ to the standard speed VfO and is used to 
drive the lens in the + direction, and a speed 402, 
which is obtained by adding the correction speed Vf- 
to the standard speed VfO and is used to drive the 

20 lens in the - direction, respectively have direction 
vectors separated from the direction vector of the 
standard speed VfO by an equal angle 7. 

First of all, the value n and m are obtained. 
According to the graph of Fig. 4, 

25 tanO = y/x, tan(e - 7) = (y - m) /x, tan(9 + 7) 

= (y +n) /x ... (6) 
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tanO ± 7) = (tane»tan7) / (l±tane»tan7) 



. . . (7) 



According to equations (6) and (7) , 



m = (x2 + y2) / (x/K + y) 



. . . (8) 



n = {x2 + y2) / {x/k - y) 



- . . (9) 



5 



for tan7 = k 



Therefore, the value n and m are obtained from 
the equations . 

The angle 7 is changed to 0.8 times the angle on 
the wide-angle side as a reference in the middle 

10 region and to twice the reference angle in the 

telephoto region in accordance with the focal length. 
With this setting, the incrementing/decrementing 
period of the sharpness signal level that changes in 
accordance with the driven state of the focus lens 605 

15 can be kept constant with respect to a predetermined 
focus lens position change amount. This decreases the 
possibility of missing a locus to be traced during 
zooming . 



20 table in bhe memory of the AF microcomputer 616 in 

correspondence with the value of the angle 7, and is 
read out, as needed, to solve equations (8) and (9) . 
If the position of the zoom lens 602 changes by x per 
unit time, the respective values can be defined as 

25 follows: zoom speed vz = x, standard focusing speed 
VfO = y, correction speed Vf+ = n, and correction 



In this embodiment, a value k is stored in a 
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speed Vf- = m. The correction speeds Vf+ and Vf- can 
be obtained from equations (8) and (9) . 

In step S805, it is checked whether the zoom 
speed set in step S801 is high or low. If high-speed 
5 zooming is determined, the flow advances to step SB 06 
to substitute the integral value of sharpness signals 
obtained in the vertical sync period for a focus 
evaluation value A to be used for zooming. If low- 
speed zooming is determined, the flow advances to step 

10 S807 to substitute the average of the integral values 
of sharpness signals from the previous vertical sync 
period to the current vertical sync period for the 
focus evaluation value A. 

It is then checked in step S808 whether zooming 

15 is from the wide-angle side to the telephoto side. If 
NO in step S808, the correction speeds are set as Vf+ 
= 0 and Vf- = 0 in step S809, and the flow jiomps to 
step S812. If YES in step S808, it is checked in step 
S810 whether the current sharpness signal level (focus 

20 evaluation value A) is lower than a threshold THl . If 
NO in step S810, the flow jumps to step S812 . If YES 
in step S810, the reverse flag is set to "1". 

In step S812, it is checked whether the reverse 
flag is at "1". If YES in step S812 , it is checked in 

25 step S813 whether the correction flag is at "1". In 
this case, the correction flag indicates whether cam 
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locus tracking is in the + direction or - direction. 
If NO in step S813, the correction flag is set to "1" 
{+ direction) in step S816, and the focusing speed Vf 
is set as follows: 

Vf = VfO + Vf+ (VfO > 0) 
= VfO - Vf+ (VfO < 0) 

for Vf+ > 0 

If YES in step S813, the correction flag is set 
to "0" in step S814, and the focusing speed Vf is set 
as follows : 

Vf = VfO - Vf- (VfO > 0) 
= VfO + Vf- (VfO < 0) 

for Vf- > 0 

If NO in step S812, i.e., the reverse flag is 
not at "1", it is checked in step S815, as in step 
S813, whether the correction flag is at "1". If YES in 
step S815, the flow advances to step S816. If NO in 
step S815, the flow advances to step S814. Finally, 
the focus motor speed Vf is set in step S817 . With the 
above operation, the zooming routine in step S705 in 
Fig. 15 is complete. Subsequently, in steps S706 and 
S707, the motors are actually driven. 

As described above, according to the third 
embodiment, when the focus position is unknown, and 
zooming is performed while the focus evaluation value 
is increased/decreased, a sharpness integral signal 



{at the current moment) in the current vertical sync 
period is used as the evaluation value in high-speed 
zooming. In low-speed zooming, the average of 
sharpness signal integral values from the previous 
5 vertical sync period to the current vertical sync 
period is used as the evaluation value. With this 
operation, the response characteristics of an 
evaluation signal are improved in high-speed zooming. 
In low-speed zooming, focusing can be performed while 

10 noise due to camera shakes is removed. Therefore, the 
focus tracking performance both in high-speed zooming 
and low-speed zooming can be improved. 
(Fourth Embodiment) 

According to the method of the third embodiment, 

15 as an evaluation signal for focus tracking in zooming 
from the wide-angle side to the telephoto side, a 
sharpness integral signal (at the current moment) in 
the current vertical sync period is used in high-speed 
zooming, whereas the average of sharpness signal 

20 integral values from the previous vertical sync period 
to the current vertical sync period is used as this 
evaluation value in low-speed zooming, thereby 
improving the focus tracking performance in zooming. 

The method of the third embodiment is, however, 

25 associated with only two zoom speeds for high-speed 
zooming and low-speed zooming. In the fourth 
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embodiment, therefore, a method associated with 
multiple zoom speeds will be described. 

Fig. 17 is a flow chart showing a procedure for 
executing this embodiment, and more specifically, the 
5 subroutine in step S705 in Fig. 15. The fourth 

embodiment differs from the third embodiment in that 
the processing in step S9 05 replaces the processing in 
steps S805 to S807 in Fig. 16. In step S905, an 
average time is determined from an average time table 

10 set in accordance with zoom speeds, and a focus 

evaluation value A is calculated. The following is an 
example of the average time table: 
Zoom Speed 1 2 3 4 5 6 

low-speed side high-speed side 

15 Average Time 3 3 2 2 11 (vertical sync period) 

When, for example, the zoom speed is "6", i.e., 
the highest speed, the average time is one vertical 
sync period, and the integral value of sharpness 
signals obtained in the current vertical sync period 

20 is used as the evaluation value A. When the zoom speed 
is "3", i.e., the middle speed, the average of the 
integral values of sharpness signals in two vertical 
sync periods is used as the evaluation value A. When 
the zoom speed is "1", i.e., the lowest speed, the 

25 average of the integral values of sharpness signals in 
three vertical sync periods is used as the evaluation 



value A. Note that this average time may be set to be 
lower than three vertical sync period in accordance 
with the zoom speed. The processing in steps S906 to 
S915 is the same as that in steps S808 to S817 in 
5 Fig. 16. 

As described above, according to the fourth 
embodiment, to calculate the evaluation value A used 
for focusing during zooming, the response 
characteristics of an evaluation value are improved in 

10 high-speed zooming. In low-speed zooming, the average 
time for the integral value of sharpness signals is 
slightly changed in accordance with multiple zoom 
speeds so as to remove noise due to camera shakes and 
the like, thereby obtaining proper evaluation values A 

15 in zooming at various zoom speeds. This can improve 
the precision in in-focus locus selection and focus 
tracking . 

(Fifth Embodiment) 

According to the methods of the third and fourth 
20 embodiments, as an evaluation signal for focus 

tracking during zooming from the wide-angle side to 
the telephoto side, the average of the integral values 
of sharpness signals is used in accordance with the 
zoom speed, thereby removing noise values due to 
25 object changes and changes such as camera shakes. 

In the methods of the third and fourth 
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embodiments, however, since the average time is 
determined in accordance with only the zoom speed, 
when the level of a video signal is low at a low 
illuminance, and electrical noise increases after the 
5 signal is amplified by an amplification circuit, no 
good effect can be obtained. In the fifth embodiment, 
therefore, a method of changing the average time 
required to calculate the evaluation value for focus 
tracking in accordance with illuminance will be 
10 described. 

Fig. 18 is a flow chart showing a procedure for 
executing this embodiment, and more specifically, the 
subroutine in step S705 in Fig. 15. The fifth 
embodiment differs from the third embodiment in that 
15 the processing in steps S1105 to S1107 replaces the 
processing in steps S805 to S807 in Fig. 16. 

In step S1105, it is checked, on the basis of 
the magnitude of the luminance signal obtained by a 
CCD 606 in Fig. 13, whether the illiiminance is low. If 
20 the luminance signal is smaller than a predetermined 
value, it is determined that the illuminance is low, 
and vice versa. If YES in step S1105, the average of 
the integral values of sharpness signals in only 
predetermined vertical sync periods is set as an 
25 evaluation value A. 

If NO in step S1105, a sharpness integral signal 
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in the current the vertical sync period is set as the 
evaluation value A. The processing in the subsequent 
steps, i.e., steps S1108 to S1117, is the same as that 
in steps S808 to S817 in Fig. 15. 
5 As described above, according to the fifth 

embodiment, when the evaluation value A for focusing 
during zooming is to be generated, an appropriate 
evaluation value A free from electrical noise can be 
obtained by changing the average time for the integral 
10 value of sharpness signals in accordance with 
illuminance information. This can improve the 
performance in in-focus locus selection and focus 
tracking . 

(Sixth Embodiment) 

15 According to the methods of the third and fourth 

embodiments, as an evaluation signal for focus 
tracking during zooming from the wide-angle side to 
the telephoto side, the average of sharpness integral 
signals is used in accordance with the zoom speed. The 

20 methods of the third and fourth embodiments, however, 
are mainly effective when changes in sharpness signal 
are caused by only object changes and movement of the 
lens. When, for example, the level of a sharpness 
integral signal decreases owing to external noise due 

25 to camera shakes and the like, the signal undergoes a 

complicated change. In the sixth embodiment, therefore. 



a method of changing the average time for a sharpness 
integral signal in accordance with external 
information such as camera shake information will be 
described. 

5 Fig. 19 shows the characteristic feature of an 

image sensing apparatus of this embodiment. Fig. 20 is 
a flow chart showing a procedure for executing the 
embodiment, and more specifically, the subroutine in 
step S705 in Fig. 15. The sixth embodiment differs 

10 from the third embodiment in that the arrangement of 
the sixth embodiment in Fig. 19 includes a shake 
detection means 12 01 using an angular speed sensor, 
acceleration sensor, or the like in addition to the 
arrangement in Fig. 13, and the processing in steps 

15 S1305 to S1307 replaces the processing in steps S805 
to S807 in Fig. 16. 

In step S13 05 in Fig. 20, it is checked whether 
camera shake information is obtained by the shake 
detection means 1201 in Fig. 19. If YES in step S13 05, 

20 the flow advances to step S1306 to set the average of 
sharpness integral values in only predetermined 
vertical sync periods as the evaluation value A. If NO 
in step S13 05, a sharpness integral signal in the 
current vertical sync period is set as the evaluation 

25 value A. The processing in the subsequent steps, i.e., 
steps S13 08 to S1317, is the same as that in steps 
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S808 to S817 in Fig. 16. 

As described above, according to the sixth 
embodiment, when the evaluation value A for focusing 
during zooming is to be generated, an appropriate 
5 evaluation value A free from noise due to camera 

shakes can be obtained by changing the average time 
for the integral value of sharpness signals in 
accordance with the camera shake information. This can 
improve the performance in in-focus locus selection 

10 and focus tracking. 

As described above, according to the third to 
sixth embodiments, when the focus lens tracks the 
object while the sharpness signal level is 
increased/decreased during zooming, sharpness signals 

15 are averaged while the average time for the sharpness 
signals is changed in accordance with the zoom speed. 
With this operation, the movement of the focus lens 
can be controlled in accordance with the focus 
evaluation value corresponding to the zoom speed set 

20 at this time, thereby improving the in-focus locus 
selection performance and tracking performance with 
respect to a change in locus in zooming. 

In addition, when the focus lens tracks the 
object while the sharpness signal level is 

25 increased/decreased during zooming, the average of 
sharpness signals is made variable by changing the 
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average time for the sharpness signals in accordance 
with the illuminance on the object. With this 
operation, the movement of the focus lens can be 
controlled in accordance with a focus evaluation value 
5 corresponding to the illuminance on the object 

photographed at this time, thereby improving the in- 
focus locus selection performance and tracking 
perfo2rmance with respect to a change in locus in 
zooming. 

10 Furthermore, when the focus lens tracks the 

object while the sharpness signal level is 
increased/decreased during zooming, the average of 
sharpness signals is made variable by changing the 
average time for the sharpness signals in accordance 

15 with external information such as camera shake 

information. With this operation, the movement of the 
focus lens can be controlled in accordance with the 
focus evaluation value corresponding to the 
presence /absence of camera shakes, thereby improving 

20 the in- focus locus selection performance and tracking 
performance with respect to external noise during 
zooming . 

Note that the image sensing apparatus according 
to each embodiment of the present invention can be 
25 applied to various types of cameras such as a video 

camera, VTR, and digital video camera. The functions 
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of the respective embodiments described above are 
mainly implemented by control operation performed by 
the AF microcomputer and the system controller. This 
control operation is performed in accordance with a 
5 program stored in a recording medium (not shown) . 

In this case, the program itself realizes the 
functions of the above-mentioned embodiments, and the 
program itself and a means for supplying the program 
to the computer, e.g., a storage medium which stores 

10 the program code, constitute the present invention. As 
the storage medium for storing the program, for 
example, a floppy disk, hard disk, optical disk, 
magneto-optical disk, CD-ROM, magnetic tape, 
nonvolatile memory card, ROM, and the like may be used. 

15 The present invention is not limited to the 

above embodiments and various changes and 
modifications can be made within the spirit and scope 
of the present invention. Therefore, to apprise the 
public of the scope of the present invention the 

20 following claims are made. 
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WHAT IS CLAIMED IS: 

1. An image sensing method comprising: 
the zooming step of performing zooming 

operation; 

5 the shutter speed control step of controlling a 

timing of a charge storage time of an image sensing 
element; and 

the control step of controlling to change a zoom 
speed in the zooming step in accordance with a shutter 
10 speed. 

2. The method according to claim 1, wherein the 
control step comprises controlling to decrease the 
zoom speed in the zooming step when the shutter speed 
is not more than a predetermined value. 

15 3. An image sensing apparatus comprising: 

zooming means for performing zooming operation; 
shutter speed control means for controlling a 

timing of a charge storage time of an image sensing 

element; and 

20 control means for controlling to change a zoom 

speed of said zooming means in accordance with a 
shutter speed. 

4 . The apparatus according to claim 3 , wherein said 

control means controls to decrease the zoom speed of 
25 said zooming means when the shutter speed is not more 
than a predetermined value . 
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5. An image sensing method comprising: 

the zooming step of performing zooming operation 
using a zoom lens; 

the focus adjustment step of correcting movement 
5 of a focal plane upon movement of said zoom lens by- 
using a focus lens; 

the driving step of independently moving said 
zoom lens and said focus lens parallel to an optical 
axis; 

10 the selection step of selecting a charge storage 

time of an image sensing element; 

the shutter speed control step of controlling a 

timing of the charge storage time of said image 

sensing element; and 
15 the control step of controlling to change a zoom 

speed in the zooming step in accordance with a shutter 

speed. 

6. The method according to claim 5, wherein the 
control step comprises controlling to decrease the 

20 zoom speed in the zooming step when the shutter speed 
is not more than a predetermined value. 

7. An image sensing apparatus comprising: 
zooming means for performing zooming operation 

using a zoom lens; 
25 focus adjustment means for correcting movement 

of a focal plane upon movement of said zoom lens by 
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using a focus lens; 

driving means for independently moving said zoom 
lens and said focus lens parallel to an optical axis; 

an image sensing element; 
5 selection means for selecting a charge storage 

time of said image sensing element; 

shutter speed control means for controlling a 
timing of the charge storage time of said image 
sensing element; and 
10 control means for controlling to change a zoom 

speed of said zooming means in accordance with a 
shutter speed. 

8 . The apparatus according to claim 7 , wherein said 
control means controls to decrease the zoom speed of 

15 said zooming means when the shutter speed is not more 
than a predetermined value. 

9 . A storage medium storing a control program for 
controlling an image sensing apparatus including 
zooming means for performing zooming operation, 

20 shutter speed control means for controlling a timing 
of a charge storage time of an image sensing element, 
and control means for controlling a zoom speed of said 
zooming means, wherein the control program has a 
control module for the step of controlling to change 

25 the zoom speed of said zooming means in accordance 
with a shutter speed. 
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10. The storage mediijin according to claim 9, wherein 
the control program has a control module for the 
control step of controlling to decrease the zoom speed 
of said zooming means when the shutter speed is not 

5 more than a predetermined value. 

11. A storage mediiim storing a control program for 
controlling an image sensing apparatus comprising 
zooming means for performing zooming operation using a 
zoom lens, focus adjustment means for correcting 

10 movement of a focal plane upon movement of said zoom 
lens by using a focus lens, driving means for 
independently moving said zoom lens and said focus 
lens parallel to an optical axis, an image sensing 
element, selection means for selecting a charge 

15 storage time of said image sensing element, shutter 
speed control means for controlling a timing of the 
charge storage time of said image sensing element, and 
control means for controlling a zoom speed of said 
zooming means, wherein the control program has a 

20 control module for the step of controlling to change 
the zoom speed of said zooming means in accordance 
with a shutter speed. 

12. The storage medium according to claim 11, 
wherein the control program has a control module for 

25 the control step of controlling to decrease the zoom 
speed of said zooming means when the shutter speed is 
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not more than a predete2rmined value. 

13 . An image sensing apparatus having an arrangement 
which can maintain an in-focus state by correcting a 
displacement of a focal plane during zooming operation, 
5 comprising: 

signal detection means for extracting a high- 
frequency component from a video signal obtained by 
photographing an object, and detecting a sharpness 
signal ; 

10 zoom speed detection means for detecting a speed 

of the zooming operation; and 

evaluation value calculation means for changing 

a time during which the sharpness signals are averaged, 

during the zooming operation, in accordance with the 
15 speed of the zooming operation, and calculating a 

focus evaluation value during the zooming operation in 

the set averaging time . 

14. The apparatus according to claim 13, wherein 
said evaluation value calculation means calculates the 

20 focus evaluation value in accordance with the speed of 
the zooming operation by shortening the averaging time 
of the sharpness signals when the zoom speed is high, 
and prolonging the averaging time of the sharpness 
signals when the zoom speed is low. 

25 15 . The apparatus according to claim 13 , wherein 
said evaluation value calculation means includes an 



averaging time table set in correspondence with 
various zoom speeds , determines the various zoom 
speeds by referring to the averaging time, and 
calculates the focus evaluation value. 
5 16. An image sensing apparatus having an arrangement 
which can maintain an in- focus state by correcting a 
displacement of a focal plane during zooming operation, 
comprising : 

signal detection means for extracting a high- 
10 frequency component from a video signal obtained by 
photographing an object, and detecting a sharpness 
signal ; 

signal extraction means for extracting a 
luminance signal from the video signal obtained by 

15 photographing the object; and 

evaluation value calculation means for changing 
a time during which the sharpness signals are averaged, 
during the zooming operation, in accordance with an 
object illuminance obtained from the luminance signal, 

20 and calculating a focus evaluation value during the 
zooming operation in the set averaging time. 
17. The apparatus according to claim 16, wherein 
said evaluation value calculation means calculates the 
focus evaluation value in accordance with the object 

25 illuminance by shortening the averaging time of the 

sharpness signals when the object illuminance is high. 
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and prolonging the averaging time of the sharpness 
signals when the object illuminance is low. 

18 . An image sensing apparatus having an arrangement 
which can maintain an in-focus state by correcting a 

5 displacement of a focal plane during zooming operation, 
comprising : 

signal detection means for extracting a high- 
frequency component from a video signal obtained by 
photographing an object, and detecting a sharpness 
10 signal; 

shake detection means for detecting a shake of 
said image sensing apparatus; and 

evaluation value calculation means for changing 
a time during which the sharpness signals are averaged, 
15 during the zooming operation, in accordance with 
information from said shake detection means, and 
calculating a focus evaluation value during the 
zooming operation in the set averaging time. 

19. The apparatus according to claim 18, wherein 

20 said evaluation value calculation means calculates the 
focus evaluation value by shortening the averaging 
time of the sharpness signals when no shake is 
detected by said shake detection means, and prolonging 
the averaging time of the sharpness signals when a 

25 shake is detected. 

20. An image sensing apparatus comprising: 
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a first lens group for zooming operation; 

a second lens group for correcting movement of a 

focal plane during movement of said first lens groups- 
signal detection means for extracting a high- 
5 frequency component from a video signal obtained by 

photographing an object, and detecting a sharpness 

signal ; 

zoom speed detection means for detecting a speed 
of the zooming operation; 
10 storage means for storing information of a focus 

position of said second lens group relative to a 
position of said first lens group in correspondence 
with an object distance; 

moving speed calculation means for obtaining a 
15 standard moving speed of said second lens group upon 
movement of said first lens group on the basis of the 
information stored in said storage means; 

speed addition means for adding a correction 
speed to the standard moving speed of said second lens 
20 group, obtained by said moving speed calculation means, 
during the zooming operation; and 

focus control means for changing a time during 
which the sharpness signals are averaged, during the 
zooming operation, in accordance with the speed of the 
25 zooming operation, calculating a focus evaluation 
value during the zooming operation in the set 
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averaging time, and changing the correction speed to 
be added to the standard moving speed in accordance 
with a magnitude of the calculated focus evaluation 
value . 

5 21. The apparatus according to claim 20, wherein 
said focus control means calculates the focus 
evaluation value in accordance with the speed of the 
zooming operation by shortening the averaging time of 
the sharpness signals when the zoom speed is high, and 
10 prolonging the averaging time of the sharpness signals 
when the zoom speed is low. 

22. The apparatus according to claim 20, wherein 
said focus control means includes an averaging time 
table set in correspondence with various zoom speeds, 

15 determines the various zoom speeds by referring to the 
averaging time, and calculates the focus evaluation 
value . 

23. An image sensing apparatus comprising: 

a first lens group for zooming operation; 
20 a second lens group for correcting movement of a 

focal plane during movement of said first lens group; 

signal detection means for extracting a high- 
frequency component from a video signal obtained by 
photographing an object, and detecting a sharpness 
25 signal; 

signal extraction means for extracting a 
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liiminance signal from the video signal obtained by 
photographing the object; 

storage means for storing information of a focus 
position of said second lens group relative to a 
5 position of said first lens group in correspondence 
with an object distance; 

moving speed calculation means for obtaining a 
standard moving speed of said second lens group upon 
movement of said first lens group on the basis of the 

10 information stored in said storage means; 

speed addition means for adding a correction 
speed to the standard moving speed of said second lens 
group, obtained by said moving speed calculation means ^ 
during the zooming operation; and 

15 focus control means for changing a time during 

which the sharpness signals are averaged, during the 
zooming operation, in accordance with an object 
illuminance obtained from the luminance signal, 
calculating a focus evaluation value during the 

20 zooming operation in the set averaging time, and 
changing the correction speed to be added to the 
standard moving speed in accordance with a magnitude 
of the calculated focus evaluation value . 
24. The apparatus according to claim 23, wherein 

25 said focus control means calculates the focus 
evaluation value in accordance with the object 
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ill-uminance by shortening the averaging time of the 
sharpness signals when the object illuminance is high, 
and prolonging the averaging time of the sha2rpness 
signals when the object illiaminance is low. 
5 25. An image sensing apparatus comprising: 

a first lens group for zooming operation; 

a second lens group for correcting movement of a 
focal plane during movement of said first lens group; 

signal detection means for extracting a high- 
10 frequency component from a video signal obtained by 
photographing an object, and detecting a sharpness 
signal ; 

shake detection means for detecting a shake of 
said image sensing apparatus; 
15 storage means for storing information of a focus 

position of said second lens group relative to a 
position of said first lens group in correspondence 
with an object distance; 

moving speed calculation means for obtaining a 
20 standard moving speed of said second lens group upon 
movement of said first lens group on the basis of the 
information stored in said storage means; 

speed addition means for adding a correction 
speed to the standard moving speed of said second lens 
25 group, obtained by said moving speed calculation means, 
during the zooming operation; and 
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focus control means for changing a time during 
which the sharpness signals are averaged, during the 
zooming operation, in accordance with information from 
said shake detection means, calculating a focus 
5 evaluation value during the zooming operation in the 
set averaging time, and changing the correction speed 
to be added to the standard moving speed in accordance 
with a magnitude of the calculated focus evaluation 
value . 

10 26. The apparatus according to claim 25, wherein 
said focus control means calculates the focus 
evaluation value by shortening the averaging time of 
the sharpness signals when no shake is detected by 
said shake detection means, and prolonging the 

15 averaging time of the sharpness signals when a shake 
is detected. 

27. A lens control method used in an image sensing 
apparatus including a first lens group for zooming 
operation and a second lens group for correcting 

20 movement of a focal plane during movement of said 

first lens group and adapted to control movement of 
said second lens group so as to maintain an in- focus 
state by correcting a displacement of a focal plane 
upon movement of said first lens group during zooming 

25 operation, comprising the steps of: 

averaging sharpness signals corresponding to a 
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predetermined time, each generated by extracting a 
high-frequency component from a video signal obtained 
by photographing an object, and calculating a focus 
evaluation value for determining a moving speed of 
5 said second lens group on the basis of the averaged 
sharpne s s si gna 1 ; and 

changing the averaging time of the sharpness 
signals during the zooming operation in accordance 
with a speed of the zooming operation. 

10 28. A lens control method used in an image sensing 
apparatus including a first lens group for zooming 
operation and a second lens group for correcting 
movement of a focal plane during movement of said 
first lens group and adapted to control movement of 

15 said second lens group so as to maintain an in-focus 
state by correcting a displacement of a focal plane 
upon movement of said first lens group during zooming 
operation, comprising the steps of: 

averaging sharpness signals corresponding to a 

20 predetermined time, each generated by extracting a 

high-frequency component from a video signal obtained 
by photographing an object, and calculating a focus 
evaluation value for determining a moving speed of 
said second lens group on the basis of the averaged 

25 sharpness signal; and 

changing the averaging time of the sharpness 
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signals during the zooming operation in accordance 
with an object ill-uminance obtained from a luminance 
signal in the video signal obtained by photographing 
the object. 

5 29. A lens control method used in an image sensing 
apparatus including a first lens group for zooming 
operation and a second lens group for correcting 
movement of a focal plane during movement of said 
first lens group and adapted to control movement of 

10 said second lens group so as to maintain an in-focus 
state by correcting a displacement of a focal plane 
upon movement of said first lens group during zooming 
operation, comprising the steps of: 

averaging sharpness signals corresponding to a 

15 predetermined time, each generated by extracting a 

high-frequency component from a video signal obtained 
by photographing an object, and calculating a focus 
evaluation value for determining a moving speed of 
said second lens group on the basis of the averaged 

20 sharpness signal; and 

changing the averaging time of the sharpness 
signals during the zooming operation in accordance 
with information from shake detection means for 
detecting a shake of said image sensing apparatus. 



ABSTRACT OF THE DISCLOSURE 
It is an object of this invention to provide an 
image sensing method which allows object focus 
tracking during zooming regardless of the shutter 
speed. In order to achieve this object, a zoom motor 
for driving a zoom lens is controlled by a lens 
control microcomputer to decrease the zoom speed. 
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ORIGINAL , DESIGN, NATIONAL STAGE OF PCT, SUPPLEMENTAL, 
DIVISIONAL. CONTINUATION OR CONTINUATION-IN-PART APPLICATION 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name, 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint 
inventor (if plural names are listed below) of the subject matter which is claimed and for which a patent is sought on the 
invention entitled: 

IMAGE SENSING METHOD, IMAGE SENSING APPARATUS, 

LENS CONTROL METHOD THEREFOR, AND STORAGE MEDIUM 

the specification of which 

a. [ X ] is attached hereto 

b. [ ] was filed on as application Serial No. and 

was amended on (if applicable). 

PCT FILED APPLICATION ENTERING NATIONAL STAGE 

C. [ ] was described and claimed in International Application No. filed on 

and as amended on .(if any). 

I hereby state that I have reviewed and understand the contents of the above-identified specification, including the claims, 
as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to the examination of this application in accordance 
with Title 37, Code of Federal Regulations, § 1.56(a). 

I hereby specify the following as the correspondence address to which all communications about this application are to 
be directed: 

SEND CORRESPONDENCE TO: MORGAN & FINNEGAN, L.L.P. 

345 Park Avenue 
New York, N.Y. 10154 

DIRECT TELEPHONE CALLS TO: MICHAEL M. MURRAY 

(212) 758-4800 

[X] I hereby claim foreign priority benefits under Title 35, United States Code § 1 19 (a)-(d) or under § 365(b) 
of any foreign application(s) for patent or inventor's certificate or under § 365(a) of any PCT international application(s) 
designating at least one country other than the U.S. listed below and also have identified below such foreign 
application(s) for patent or inventor's certificate or such PCT international application(s) filed by me on the same 
subject matter having a filing date within twelve (12) months before that of the application on which priority is 
claimed: 



[X] The attached 35 U.S.C. § 1 19 claim for priority for the application(s) listed below forms a part of this 
declaration. 
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[ ] I liereby claim the benefit under 35 U.S.C. § 1 19(e) of any U.S. provisional application(s) listed below. 
Provisional Application No. Date of filing (day, month, vr) 



ADDITIONAL STATEMENTS FOR DIVISIONAL, CONTINUATION OR CONTINUATION-IN-PART 
OR PCT INTERNATIONAL APPLICATIONfS DESIGNATING THE U.S.) 

I hereby claim the benefit under Title 35, United Slates Code § 120 of any United States application(s) or under § 365(c) 
of any PCT international application(s) designating the U.S. Usted below. 



US/PCT Application Serial No. Filing Dale, Status (patented, pending, abandoned)/ 

U.S. application no. assigned (For PCT) 



US/PCT Application Serial No. Filing Date, Status (patented, pending, abandoned)/ 

U.S. application no. assigned (For PCT) 

[ ] In this continuation-in-part application, insofar as the subject matter of any of the claims of this application 
is not disclosed in the above listed prior United Stales or PCT international application(s) in the manner provided by the 
first paragraph of Title 35, United States Code, § 1 12, I aclcnowledge the duty to disclose material information as 
defined in Title 37, Code of Federal Regulations, § 1.56(a) which occurred between the filing date of the prior 
application(s) and the national or PCT international filing date of this application. 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge that 
willful false statements and the like so made are punishable by fine or Imprisonment, or both, under Section 1001 of 
Title 18 of the United States Code and that such willful false statements may jeopardize the validity of the application 
or any patent issued thereon. 

I hereby appoint the following attorneys and/or agents with full power of substitution and revocation, to prosecute this 
application, to receive the patent, and to transact all business in the Patent and Trademark Office connected therewith: 
John A. Diaz (Reg. No. 19,550), John C. Vassil (Reg. No. 19,098), Alfred P. Ewert(Reg. No. 19,887), David H. 
Pfeffer, P.C. (Reg. No. 19,825), Harry C. Marcus (Reg. No. 22,390), Robert E. Paulson (Reg. No. 21,046), Stephen 
R. Smith (Reg. No. 22,615), Kurt E. Richter (Reg. No. 24,052), J. Robert Dailey (Reg. No. 27,434), Eugene Moroz 
(Reg. No. 25,237), John F. Sweeney (Reg. No. 27,471), Arnold I. Rady (Reg. No. 26,601), Christopher A. Hughes 
(Reg. No. 26,914), William S. Feiler (Reg. No. 26,728), Joseph A. Calvaruso (Reg. No. 28,287), James W. Gould 
(Reg. No. 28,859), Richard C. Komson (Reg. No. 27,913), Israel Blum (Reg. No. 26,710), Bartholomew Verdirame 
(Reg. No. 28,483), Maria C. H. Lin (Reg. No. 29.323), Joseph A. DeGirolamo (Reg. No. 28,595), Michael A. 



Nicodema (Ref. No. 33,199), Michael P. Dougherty (Ref. No. 32,730), Seth J. Altas (Reg. No. 32,454), Andrew M. 
Riddles (Reg. No. 31,657), Bruce D. DeRenzi (Reg. No. 33,676), Michael M. Murray (Reg. No. 32,537) and Mark J. 
Abate (Reg. No. 32,527); Alfred L. Haffiier, Jr. (Reg. No. 18,919), Harold Haidt (Reg. No. 17,509),' John T. Gallagher 
(Reg. No. 35,516), Steven F. Meyer (Reg. No. 35.613); Kenneth H. Sonnenfeld (Reg No. 33,285), Edwaid A. 
Pennington (Reg. No. 32,588), Michael S. Marcus (Reg. No. 31,727) and John E. Hoel (Reg. No. 26,279) of Morgan 
& Finnegan, L.L.P., whose address is: 345 Park Avenue, New York, New York 10154. 

[ ] I hereby authorize the U.S. attorneys and/or agents named hereinabove to accept and follow 
instructions from 



action to be taken in the U.S. Patent and Trademark Office regarding this application without direct 
communication between the U.S. attorneys and/or agents and me. In the event of a change in the person(s) 
from whom instructions may be taken I \vill so notify the U.S. attorneys and /or agents named hereinabove. 

Full name of sole or first inventor Taeko TANAKA 



Inventor's signature* ^^aM'^^j^ '^^^ 



324-72, Hazawacho, Kanagawa-ku, ^Ji^^'-'^ ' 
Residence Yokohama - shi , Kanaaawa-ken . Japan 

Citizenship JAPAN 

c/o CANON KABUSHIKI KAISHA, 
Post Office Address 3 0-2, Shimomaruko 3-choine, Ohta-ku, Tokyo. Japan 

Full name of second joint inventor, if any 
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date 

Residence 



Citizenship_ 
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[ ] ATTACHED IS ADDED PAGE TO COMBINED DECLARATION AND POWER OF ATTORNEY 
FOR SIGNATURE BY THIRD AND SUBSEQUENT INVENTORS FORM. 

* Before signing this declaration, each person signmg must: 

1. Review the declaration and verify the correctness of all information therein; and 

2. Review the specification and the claims, including any amendments made to the claims. 
After the declaration is signed, the specilication and claims are not to be altered. 



To the inventor(s): 



The following are cited in or pertinent to the declaration attached to the accompanying application: 

Title 37. Code of Federal Regulation. § 1.56 

Duty to disclose information material to patentability. 

(a) A patent by its very nature is affect with a public interest. The public interest is best served, 
and the most effective patent examination occurs when, at the time an application is being examined, 
the Office is aware of and evaluates the teachings of all information material to patentability. Each 
individual associated with the filing and prosecution of a patent application has a duty of candor and 
good faith in dealing with the Office, which includes a duty to disclose to the Office all information 
known to that individual to be material to patentability as defined in this section. The duty to disclose 
information exists with respect to each pending claim until the claim is canceled or withdrawn from 
consideration, or the application becomes abandoned. Information material to the patentability of a 
claim that is canceled or withdrawn from consideration need not be submitted if the information is not 
material to the patentability of any claim remauung under consideration in the application. There is no 
duty to submit information which is not material to the patentability of any existing claim. The duty to 
disclose all information known to be material to patentability is deemed to be satisfied if all 
information known to be material to patentability of any claim issued in patent was cited by the Office 
or submitted to the Office in the manner prescribed by §§ 1 .97(b)-(d) and 1 .98. However, no patent will 
be granted on an application in connection with which fraud on the Office was practiced or attempted 
or the duty of disclosure was violated through bad faith or intentional misconduct. The Office 
encourages applicants to carefully examine; 

(1) prior art cited in search reports of a foreign patent office in a counterpart application, 

and 

(2) the closest information over which individuals associated with the filing or 
prosecution of a patent application believe any pending claim patentably defines, to 
make sure that any material information contained therein is disclosed to the Office. 

Title 35. U.S. Code § 101 
Inventions patentable 

Whoever invents or discovers any new and usefiil process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and 
requirements of this title. 

Title 35 U.S. Code § 102 

Conditions for patentability; novelty and loss of right to patent 
A person shall be entitled to a patent unless - 

(a) the mvention was known or used by others in this country, or patented or described in a 
printed puMication in this or a foreign country, before the invention thereof by the applicant for patent, 

(b) the invention was patented or described in a printed publication in this or foreign country or in 
public use or on sale in this country, more than one year prior to the date of application for patent in the United 
States, or 

-4- 

447486_I 



(c) he has abandoned the invention, or 

(d) the invention was first patented or caused to be patented, or was the subject of an inventor's 
certificate, by the applicant or his legal representatives or assigns in a foreign country prior to the date of the 
application for patent in this country on an application for patent or inventor's certificate field more than twelve 
months before the filing of the application in the United States, or 

(e) the invention was described in a patent granted on an application for patent by another filed in 
the United States before the invention thereof by the applicant for patent, or on an international application by 
another who has fulfilled the requirements of paragraphs (1), (2), and (4) of section 371(c) of this title before 
the invention thereof by the applicant for patent, or 

(f) he did not himself invent the subject matter sought to be patented, or 

(g) before the appUcant's invention thereof the invention was made in this country by another had 
not abandoned, suppressed, or concealed it. In determining priority of invention there shall be considered not 
only the respective dates of conception and reduction to practice of the invention, but also the reasonable 
diligence of one who was first to conceive and last to reduce to practice, from a time prior to conception by the 
other . . . 

Title 35. U.S. Codes 103 

Conditions for patentability; non-obvious subject matter 

A patent may not be obtained though the invention is not identically disclosed or described as set forth 
in section 102 of this title, if the differences between the subject matter sought to be patented and the prior art 
are such that the subject matter as a whole would have been obvious at the time the invention was made to a 
person having ordinary skill in the art to which said matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

Subject matter developed by another person, which qualifies as prior art only under subsection (f) or 
(g) of section 102 of this title, shall not preclude patentability under this section where the subject matter and the 
claimed invention were, at the time the invention was made, owned by the same person or subject to an 
obligation of assignment to the same person. 

Title 35. U.S. Code S 112 pa.rt^ 
Specification 

The specification shall contain a written description of the invention, and of the maimer and process of 
making and using it, in such full, clear, concise and exact terms also enable any person skilled in the art to 
which it pertains, or with which it is mostly nearly connected, to make and use the same, and shall set forth the 
best mode contemplated by the inventor of carrying out his invention. 

Title 35. U.S. Code § 119 

Benefit of earlier filing date in foreign country; right of priority 

An application for patent for an invention filed in this country by any person who has, or whose legal 
representatives or assigns have, previously regularly filed an apphcation for a patent for the same invention in a 
foreign cotmtry which affords similar privileges in the case of applications filed in the United States or to 
citizens of the United States, shall have the same effect as the same application would have if filed in this 
country on the date on which the application for patent for the same invention was first filed in such foreign 
country, if the application in this country is filed within twelve months from the earliest date on which such 
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foreign application was filed; but no patent shall be granted on any application for patent for an invention which 
had been patented or described in a printed publication in any country more than one year before the date of he 
actual filing of the application in this country, or which had been in public use or on sale in this country more 
than one year prior to such filing. 



Title 35. U.S. Code g 120 

Benefit or earlier filing date in the United States 

An application for patent for an invention disclosed in the manner provided by the first paragraph of 
section 1 12 of this title in an application previously filed in the United States, or as provided by section 363 of 
this title, which is filed by an iaventor or inventors named in the previously filed application shall have the same 
effect, as to such invention, as though filed on the date of the prior application, if filed before the patenting or 
abandonment of or termination of proceedings on the first application or an application similarly entitled to the 
benefit of the filing date of the first application and if it contains or is amended to contain a specific reference to 
the earlier filed application. 

Please read carefully before signing the Declaration attached to the accompanying Application. 
If you have any questions, please contact Morgan & Finnegan, L.L.P. 
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